GAME DEVICE, PICTURE DATA FORMING METHOD AND MEDIUM 
BACKGROUND OF THE INVENTION 

The present invention relates to a video game device. More particularly, this invention 
relates to a game device which is installed at amusement centers or at home and which is capable 
5 of expressing more realistic pictures. 

With the progress of computer technology, video game devices utilizing computer 
graphics technology have come to be widely used. This type of video game devices are widely 
accepted by users. A large number of various kinds of game devices have been devised and 
10 various game software products which run on such game devices have been supplied. 



It is desirable that pictures be displayed in more realistic expressions on a screen so that 
users would be able to enjoy video games fully. Foe example, with a vehicle race such as a car 
race, it is desirable that movements of cars and the background be expressed naturally and that 
1 5 anything which may occur during the drive, for example, reflection of light on a windshield be 
expressed as special effects on a screen. Moreover, it will be interesting if traces of tire slips of a 
car appear. 

On the other hand, since complicated arithmetic operations such as coordinate 
transformation are repeated for three-dimensional screen display, the amount of operation borne 
20 by CPU becomes enormous. Accordingly, if special effects or the like of picture expressions are 
performed, the number of polygons to be displayed on the screen must be decreased by the 
amount of operation to be used for such special effects. 



Therefore, it is a first object of this invention to provide a video game device capable of 
expressing a picture with which a game player can perceive dazzling light fi'om a light source. 



It is a second object of this invention to provide a game device capable of expressing, on 
5 a screen, traces of a moving object in a video game. 



It is a third object of this invention to provide a method of decreasing the amount of 
operation in a drawing routine when developments of a game in the three-dimensional virtual 
space are displayed on a two-dimensional screen so that pictures on the screen may seem to be 
1 0 three-dimensional. 



SUMMARY OF THE INVENTION 

In order to achieve the above-mentioned objects, a game device of the present invention 
displays a picture of a scene that has come into view by moving a visual point of a virtual camera 

15 in a three-dimensional virtual space, and the game device comprises a flare processing means 
(SI 02 through S118) for forming a flare in a picture when a light source exists within view. The 
flare processing means comprises: a line-of-sight vector generating means (SI 06) for obtaining 
a line-of-sight vector which shows a line-of-sight direction of the visual point; a ray vector 
generating means (SI 04) for obtaining a ray vector which shows a direction of the Hght source 

20 fi:om the visual point; an inner product calculating means (SI 08) for calculating an inner product 
of the line-of-sight vector and the ray vector; and a flare foraiing means (S112 through S118) for 
forming a flare having intensity according to the inner product in the picture. This makes it 
possible to form a flare in accordance with the position of the light source fi-om the visual point 
and/or the intensity of the light soxirce. Expressions are made more closer to real scenes and it is 
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possible to form game pictures with strengthened image effects, thereby making game more 
amusing. 

The game device of this invention further comprises a determining means (SI 10) for 
5 activating the flare forming means on the basis of the results of comparison of the inner product 
with a reference value. This makes it possible to prevent lowering of the picture quality by 
avoiding the formation of flares and performing flare processing when the intensity of the light 
source is not strong enough to generate flares. 

10 The flare forming means increases a degree of whiteness of the picture in accordance 

with the iimer product (SI 12). This causes an influence (or flare effect) of the flares upon the 
picture to be expressed. 

The flare forming means forms a picture of flare polygons having transparency according 
15 to the inner product (S 1 1 4, S 1 1 8). This makes it possible to express flares of a camera lens. 

The flare forming means conducts, with the inner product being between a predetermined 
upper limit and a predetermined lower limit, at least any one of the processing to add whiteness 
to the picture according to the inner product and the processing to form a flare polygon having 
20 transparency according to the inner product. This makes it possible to avoid formation of flares 
with a light source having weak intensity and to avoid excessive flare processing with a light 
source having strong intensity. 
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The flare forming means forais the flare on a straight line linking the visual point with the 
light soxirce (51 16, SI 18). This makes it possible to express the incidence of rays into a virtual 
camera. 



5 A game device of this invention is a game device for displaying, as a picture, a scene 

having come into view by moving a visual point in a three-dimensional virtual space. The game 
device comprises a flare processing means for forming a flare in the picture when a light source 
exists within view of the visual point. The flare processing means determines a flare degree in 
accordance with the likes of a position of the light source within view and intensity of the light 
10 source. In doing so, it is possible to determine the flare degree at an appropriate value by using a 
table or a function in consideration of the above-mentioned upper limit and lower limit or the 
like. 



The flares re expressed by, for example, displaying on a screen a flat figure having a 
15 comparatively higher degree of whiteness than that of the background or a hollow flat figure. 
Repeating display and no display of the flares in a short period of time, that is, flashing makes it 
possible to make it look like a real situation of flare formation. Moreover, it is possible to avoid 
continuous obstmction on a picture of the background by flares (particularly, flare pictures which 
are not hollow), thereby avoiding interruption with operation of a game. 

20 

It is possible to make the flares look like real ones by displaying a plurality of flares on a 
straight line corresponding to an incident ray. In doing so, it is possible to reduce a burden on 
arithmetic operation by forming a plurahty of flares to be displayed by using similar figures. 
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The light source is a virtual sun located in the three- dimensional virtual space. The 
virtual sun is relocated from a normal position to a position within view of a predeteraiined scene 
in order to generate the flare in the picture on the predetermined scene. This makes it possible to 
dramatically present a game scene by intentionally causing the light source to exist in the game 
scene and by generating flares. 

A game device of this invention is a game device for displaying, as a picture, an object 
moving in accordance with developments of a game. The game device comprises: a means 
(S132) for reading a present position of the object; and a trace mark drawing means (S132 
through S158) for drawing a trace mark in length within a predetermined range from the present 
position and for extinguishing a bottom position of the trace mark by making it gradually lighter 
in color with the lapse of time. This makes it possible to reduce the amount of operation for 
picture processing by reducing trace polygons of, for example, tires. 

It is preferable that the trace mark consist of plural portions, each portion having an 
assigned pattern which becomes Ughter in color from a top position of the trace mark toward a 
bottom position of the trace mark. As the trace pattern assigned to each portion, a previously 
formed pattem can be used. It is possible to change the transparency of a basic trace pattern and 
use it as a pattem for each portion. 

The trace mark drawing means extends only the top position of the trace mark (S142 
through SI 52) when the present position of said object is located less than a predetermined value 
apart from the top position of the drawn trace mark (SI 34), and the trace mark drawing means 
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moves, by the predetermined value, the trace mark in its entirety toward the present position of 
the object (S136 through S158) when the present position of the object is located not less than 
the predetermined value apart from the top position of the drawn trace mark. This makes it 
possible to draw the trace mark which will not give a sense of incompatibility to a game player, 
and to limit the length of the trace mark in its entirety to a constant length and restrain the 
amoimt of operation for the picture processing from increasing. 

The trace ma k drawing means adjusts the timing to extinguish the drawn trace according 
to a moviiig speed of the object (S132 through S158). 

The trace mark drawing means does not extinguish the drawn trace mark when the object 
stands still, while the trace mark drawing means extinguishes the drawn trace mark quickly at a 
speed according to a moving speed of the object when the object is moving (SI 32 through SI 58). 
This allows the trace mark to follow the movements of the object. 

Moreover, it is preferable that the trace mark drawing means delete the dravra trace mark 
when the object stops and a predetermined amount of time has passed. This makes it possible to 
reduce the number of display polygons (or slip traces) and to lessen a burden on the operation of 
the CPU. 

The trace mark drawing means has: a cyclic register (as shown in Figure 10) for 
retaining positions of respective portions of a mark, which consists of the plural portions (as 
shown in Figure 9), in a plurality of storage regions which respectively correspond to the 
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respective portions of the mark; and a mark top position indicating means (as shown in Figures 6 
and 8) for indicating a storage region of the cycUc register, which corresponds to the top position 
of a mark. 

5 A medixim of this invention stores a program for making a computer system function as a 

game device as described above. 

A method of forming picture data of this invention comprises the steps of: locating an 
object composed of polygons in a three-dimensional virtual space (S202); setting a visual point 

10 in the three-dimensional virtual space and forming a projected picture by projecting polygons in 
a display region as seen from this visual point on a plane of projection (S254); identifying 
whether each polygon is visible or invisible from the visual point according to the projected 
picture formed on the plane of projection (S256); forming object data from data showing whether 
each polygon is visible or invisible (5212); and relating the visual point with the object data 

15 (S216). 

A method of forming picture data of this invention comprises the steps of: locating all 
objects composed of polygons in a three-dimensional space (S202); setting a plurality of visual 
points in the three-dimensional space (S204); forming a projected picture for each visual point by 
projecting, on a plane of projection for each visual point, the polygons within a display region as 
20 seen from each visual point (S252, S254); identifying whether each polygon is visible or 
invisible from each visual point according to the projected picture formed on the plane of 
projection (S256); forming data showing whether each polygon is visible or invisible from visual 
point on the basis of the results of the identification (S258); forming a plurality of object data by 
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making the same or similar pattems into a group in accordance with a data pattern of each 
polygon, the data representing whether the polygon is visible or invisible from each visual point 
(S212); and forming an object table representing object data which can be seen from each visual 
point (S2 16). 

5 A medium of this invention stores a program for having a computer system execute each 

step of the above-described method of forming picture data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a ftmctional block diagram of a game device according to an embodiment of 
10 the present invention. 

Figure 2 is a flowchart which explains an algorithm of flare formation. 

Figure 3 describes conditions of flare generation. 

15 

Figure 4 shows an example of a flare generated screen. 
Figure 5 is a flowchart which explains another algorithm of flare formation. 
20 Figure 6 is a graph which explains the algorithm shown in Figure 5. 

Figure 7 describes an example in which a flare degree is foimd by referring to a table. 
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Figure 8 describes an example in which a flare is intentionally generated by moving a 
light source. 

Figure 9 is a flowchart which describes an algorithm to display a tire mark. 
Figure 10 describes the content of RAM. 

Figure 1 1 describes the state of RAM when one roxmd of writing has been finished. 

Figure 12 describes tire marks drawn by RAM as shown in Figure 11. 

Figure 13 describes a correspondence relationship between the RAM number and the tire 
mark patterns. 

Figure 14 shows a picture in which slip marks are drawn. 

Figure 15 shows an example of objects located in a three-dimensional virtual space. 
Figure 16 shows an example in which the object includes invisible portions in a display 

region. 

Figure 17 shows an example in which the invisible portions (polygons) of the object have 
been deleted. 



Figure 18 is a block diagram which explains the outline of a picture data processing 

device. 

5 Figure 19 is a flowchart explaining an example of formation of an object data base by 

deleting polygons which are invisible from a camera in the display region. 

Figure 20 is a flowchart explaining an example in which it is determined whether the 
polygons are visible or invisible. 

10 

Figure 21 is a table showing whether the polygons are visible or invisible. 

Figure 22 explains how polygon data are made into object groups. 

15 Figure 23 explains a transformation table according to which objects to be drawn are 

selected according to the camera ID. 

Figure 24 shows a picture drawn in a three-dimensional mode as seen from a normal 
visual point. 

20 

Figure 25 shows a picture when the visual point is moved upward in the same three- 
dimensional virtual space as that of Figure 24. 



DETAILED DESCRIPTION OF THE INVENTION 

The construction of a game device capable of executing an algorithm concerning pictures 
of special effects according to this invention is hereinafter explained with reference to drawings. 

5 Figure 1 is a block diagram showing the outline of a video game device. This device is 

composed of: a CPU block 10 for controlling the device in its entirety; a video block 1 1 for 
controlling the display of a game screen; a sound block 12 for generating effect sound or the like; 
a subsystem 13 for reading a CD-ROM; and other elements. 

10 The CPU block 10 is composed of an SCU (System Control Unit) 100, a main CPU 101, 

a RAN 102, a ROM 103, a cartridge I/F la, a sub-CPU 104, a CPU bus 103 and other elements. 
The main CPU 101 controls the device in its entirety. This main CPU 101 comprises the same 
operating function inside as that of a DSP (Digital Signal Processor) and is capable of executing 
application software at a high speed. 

15 

The RAM 102 is used as a work area for the main CPU 101 . the ROM 103 has, for 
example, an initial program for initiahzation written thereon. The SCU 100 is designed to 
perform smooth input and output of data between, for example, the main CPU 101, a VDP 120 
and 130, a DSP 140, and a CPU 141. The SCU 100 comprises a DMA controller inside and is 
20 capable of transmitting object (or sprite) data during a game to a VRAM within the video block 
11. This makes it possible to execute appUcation software of, for example, a game at a high 
speed. The cartridge I/F is designed to input application software which is suppHed in a ROM 
cartridge form. 




The sub-CPU 104 is called an SMPC (System Manager & Peripheral Control) and is 
provided with, for example, a function to collect peripheral data from an input device 2b through 
a connector 2a upon request of the main CPU 101 . The main CPU 101 conducts processing to 
move, for example, a car (or object) on a game screen on the basis of the peripheral data received 
5 from the sub-CPU 104. An operating unit, which comprises a handle, an accelerator and a break, 
is connected to the connector 2a. It is also possible to connect optional peripherals such as a pad, 
a joystick or a keyboard to the connector 2a. Connecting two operating imits 2b to the coimector 
2a makes it possible to perform a car race for plural game players. The sub-CPU 104 is provided 
with a fimction to automatically recognize the type of peripheral connected to the connector 2a 
10 (at a terminal on the main frame side) and to collect peripheral data or the like in a 
communication format in accordance with the type of peripheral. 



The video block 1 1 comprises: a VDP (Video Display Processor) 120 which mainly 
performs drawing of, for example, objects composed of polygon data in a video game; and a 
15 VDP 130 which mainly performs drawing of background pictures, synthesis of polygon picture 
data (of objects) with the backgroimd pictures, and clipping processing. 

The VDP 120 is connected to a VRAM 121 and a plurality of frame buffers (two buffers 
122 and 123 are shown in Figure 1). A command to draw polygons which represent objects for a 
20 video game device is sent from the main CPU 101 to the SCU 100 and then to the VDP 120 and 
is then written on the VRAM 121. The VDP 120 reads the drawing command prom the VRAM 
into a system register inside and writes drawing data into the frame buffer. Drawing data of the 
frame buffer 122 or 123 is sent to the VDP 130. The VDP 120 is provided with, for example, the 
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functions of: texture parts display to display objects in fixed forms, expanded or contracted 
objects, deformed objects or the like; formless objects display to display quadrilateral polygons, 
polylines, lines or the like; color operations such as semitransparent operation between parts, 
semiluminance operation, shadow operation, graduation operation, mesh operation or shading 
5 operation; mesh processing; and operation to perform clipping in order to avoid drawing in 
regions other than the display region which has been set. The VDP 120 also comprises a 
geometrizer which performs matrix operations and is capable of quickly performing operations 
such as expansion, contraction, rotation, deformation or coordinate transformation. 

The VDP 130 is connected to a VRAM 131 and it is constructed in a manner such that 
picture data outputted fi-om the VDP 130 is outputted to an encoder 160 through a memory 132. 
In addition to the functions that the VDP 120 has, the VDP 130 is provided with, for example, a 
scrolling function to control a scroll picture display and a priority function to determine the 
priority order to display objects and pictures. 

The encoder 160 adds synchronization signals or the like to the picture data, thereby 
generating video signals which are then outputted to a TV picture receiver 5 (or projector). 
Accordingly, pictures of van us kinds of games are displayed on the TV picture receiver 5. 

20 The soimd block 12 is composed of a DSP 140 for synthesizing sound in the PCM format 

or the FM format, and the CPU 141 for, for example, controlling the DSP 140. Soimd data 
generated by the DSP 140 are converted into two-chaimel signals by a D/A converter 170, which 
are then outputted to a speaker 5b. 




The subsystem 13 is composed of a CD-ROM drive lb, a CD I/F 180, a CPU 181, an 
MPEG AUDIO 182, an MPEG VIDEO 183 and other elements. This subsystem 13 has 
functions, for example, to read application software supplied in the CD-ROM form and to 
reproduce animation. The CD-ROM drive lb is designed to read data from a CD-ROM. The 
5 CPU 181 performs processing such as control of the CD-ROM drive lb and correction of errors 
in the read data. The data read from a CD-ROM are supplied to the main CPU 101 through the 
CD I/F 180, a bus 106 and the SCU 100 and are utilized as application software. The MPEG 
AUDIO 182 and the MPEG VIDEO 183 are devices for restoring data which are compressed in 
the MPEG (Motion Picture Expert Group) standards. Restoration of the MPEG compressed 
10 data, which are written on a CD-ROM, by using these MPEG AUDIO 1 82 and MPEG VIDEO 
1 83 makes it possible to reproduce animation. 

A first embodiment of special effects in pictures of this invention is hereinafter explained 
with reference to Figures 2, 3 and 4. 
15 In this embodiment, when a ray enters a so-called virtual camera from a light source in 

course of developments of a game, flares from the ray are generated in pictures, thereby 
providing more realistic pictures. Figure 2 is a flowchart which explains an algorithm of flare 
formation. Figure 3 explains how conditions on the flare formation are determined. Figure 4 
shows an example of a picture in which flares are generated. 

20 



The CPU 101 develops a car race game in a three-dimensional virtual space in 
accordance with a main game program and data of driving operation (not shown). The main 
game program and data are suppUed by means of an information storage medium such as a ROM 
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cartridge, CD-ROM or floppy disk, and are previously loaded on the memory. Moreover, the 
program and data may be downloaded through the medium of communication networks such as 
the Intemet, personal computer communication or satellite communication, or broadcasting. The 
CPU 101 locates objects such as cars and background in the three-dimensional virtual space and 
5 controls positions, movements or the like of the objects in synchronization with frame cycles of 
the TV picture receiver. 

Figure 3 shows a situation where the three-dimensional virtual space is observed from a 
virtual camera which corresponds to a visual point of a game player or driver. Li Figure 3, the 
reference nimieral 21 is a virtual camera (or a visual point), the reference mmieral 22 is a plane 
of projection which corresponds to a screen of a television monitor, the reference numeral 23 is 
the three-dimensional virtual space where a game is developed, the reference numeral24 is a 
virtual light source located in the three-dimensional virtual space, and the reference numeral 25 
is a range of view the virtual camera. The letter "A" indicates a unit vector on a line linking a 
camera position and the light source. The letter "B" indicates a unit vector existing in a facing 
direction of the virtual camera. The letter is an angle formed by the vectors A and B. 
However, as described below, the vector is not limited to the unit vector. 

The CPU 101 determines whether or not a light source polygon 24 of the sun, street lights 
20 or the like is within view (or a screen) 25 of the virtual camera during the execution of the main 
game program (SI 02). Objects to be located in the virtual space for each scene are previously 
made into data bases and, therefore, it is possible to acknowledge the existence of the light 
source object according to the individual number of objects listed up for the relevant scene. 
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If the light source object does not exist within view, flares are not generated and this 
picture processing is terminated. 

If the light source object exists, the CPU 101 determines to what extent the camera is 
5 facing in the direction of the light source or in what position relationship the light source is 

located within view in order to determine, for example, whether or not rays from the light source 
may enter the camera lens or the degree of influence of incident light. For this purpose, a 
segment linking the camera position with the light source object in the three-dimensional virtual 
space is found and then the vector A in unit length is obtained (SI 04). A facing direction of the 

10 camera 21 in the three-dimensional virtual space on this scene is foimd from the data base and 
then the unit vector B which represents the facing direction of the camera is obtained (SI 06). An 
inner product C of the unit vectors A and B, that is, C= | A | • | B | cos ^ is calculated. If the 
directions of both xmit vectors A and B coincide with each other, ^ is 0 degrees and the inner 
product is 1 . On the contrary, as the directions of both vectors become wider apart, the inner 

15 product becomes closer to 0 (SI 08). In order to reflect the intensity of the light source on the 
inner product C, the value of the vector A is set as not the unit length "1," but a value 
corresponding to the intensity of the light source. In this case, the vector A corresponds to an 
incident light having a direction and size (or strength of light). 

20 The CPU 101 compares the inner product with a reference value which is previously 

determined as a condition of flare generation. It determines whether or not the inner product C 
exceeds the reference value (or threshold value) (SI 10). If the inner product C does not exceed 
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the reference value, flares are not generated or it is determined that the circumstances do not 
require the generation of flares. 

Accordingly, this picture processing is terminated and retums to the main program. The 
5 flare processing should be performed to the extent that a game player can recognize that a picture 
is influenced by the light source. Otherwise, the flare processing (for example, a fog effect as 
described below) may cause a kind of deterioration of picture quality. Such deterioration of 
picture quality can be avoided by the above-described determination (SI 10). 



10 If the inner product C exceeds the reference value, the CPU 101 performs the flare 

processing. As the value C of the inner product is larger, it means that a ray comes straight from 
the light source and enters the camera lens, thereby stronger flares are generated. Accordingly, 
whiteness is added to a picture in proportion to the value C, thereby causing a so-called "fog 
effect." This can be realized by changing luminance and chromaticity parameters for color 

15 operations of the VDP 120 and 130 (SI 12). .Subsequently, a transparency D in proportion to the 
value C is found (SI 14). A line linking the camera position with the^ light source object is 
converted into a line E on a two-dimensional screen and a route of the ray in a screen picture is 
specified (S116). Flare polygons having the transparency D are drawn at appropriate positions 
along the line E. For example, if the transparency D is semitransparent, half of the luminance of 

20 a ground picture is added to half of the luminance of the flare polygons, and the results of 

addition are drawn on the frame buffer, thereby obtaining a flare picture (SI 18). If a plurality of 
light source polygons which have a large quantity of light exist within view, the above-described 
flare generation processing is performed for each polygon. 



Only one of the fog effect and the flare polygon processing may be performed. If the 
light source exists within view (SI 02: Yes), the light source exerts some influence. The degree of 
influence is controlled by the inner product C. Accordingly, it is not indispensable to set a 
threshold value (SI 10). For example, if the hght source exists within view, the transparency of 
5 the flare polygons r may be adjusted according to the inner product C. In addition, once the 
inner product C exceeds the threshold value, the fog effect may be caused in proportion to the 
inner product C. Moreover, it is possible to adjust the whiteness and transparency of the picture 
by considering the type of the light source such as the sim or street light, and the intensity of the 
Hght source. 

10 Figure 4 shows a situation where flares are generated in a picture during a race. In this 

example, the light soxirce object exists on the upper right side of the screen and ring-shaped flare 
polygons and circ le-shaped flare polygons are displayed along the line E (not shown). The 
shape of the flare polygons is not limited to generally circular contours as shown in Figure 4. 
For example, the flare polygons may have polygonal contours. Other than the semitransparent 

1 5 processing of the flare polygons, the flare polygons which have been previously formed may be 
displayed as they are without performing the semitransparent processing. If such flare polygons 
are displayed in the expression form of flashing by repeatedly displaying and extinguishing the 
flare polygons, the backside of the flare polygons can be seen intermittently. Accordingly, the 
same effect can be obtained as in the case where a figure with its inside not extinct, that is, the 

20 figure which is not hollow or annular is made into a figure without its inside, or as in the case 
where the flare polygons are made semitransparent. Therefore, the background can be seen and 
the operations of a game will not be obstructed. It is also possible to make the flare polygons 
look like real flares. 
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Display of flares is not limited to the display of the flare polygons. Flat figures 
representing flares may be used to perfomi picture synthesis. In the case of flare flashing as 
described above, it is possible to use flares fomied with flat figures (or preferably hollow figures, 
or generally circular or polygonal figures corresponding to lens flares) which are tinted color 
5 with higher whiteness than the background because of the fog effect, to perform the picture 
synthesis, and to display a plurality of figures similar to such flat figures on a line which 
corresponds to an incident light and which links the visual point with the light source. In this 
case, a burden on operations is comparatively small. 

Figures 5 and 6 show another embodiment of the flare processing. In this example. Step 

10 SI 10 of the flowchart shown in Figure 2 is modified. As shown in Figure 6, an upper limit CU 
and a lower limit CL are set in using the value C of the inner product. If the inner product C 
exceeds the upper limit CU (SI 10a: CU<C), the inner product is set at the value CU (SI lOd). 
This makes it possible to prevent a picture from becoming too white because of the flares. If the 
inner product C is less than the lower limit (SI lOa: C<CL), the inner product C is set at the value 

15 CL (SI lOb) in order to produce a constant flare effect. Moreover, if the inner product C is 
between the upper limit CU and the lower limit CL (SI 00a: CL< C < CU), a modification 
function f(C) is used to obtain a modified value C'=f(C). As described above, it is possible to 
perform the flare processing more effectively by modifying the inner product as appropriate. 

20 In the example as shown in Figure 2, the inner product C is utilized to determine the flare 

degree. However, it is possible to perform similar processing without necessarily calculating the 
inner product C. 
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Figure 7 shows two examples in which the flare degree is determined by referring to 
tables. The flare degree is also represented as C for convenience. 

If a virtual light source exists on the screen at the aforementioned step S102 (S102: Yes), 
5 the flare value C corresponding to a position of the virtual light source (for example, an angle 9 
formed by the vector A and the vector B) can be decided by referring to a table shown in Figure 
7(a). The position of the virtual light source may have a coordinate value (x, y) on the screen or 
within view 25. It is possible to previously store such a table on a CD-ROM lb as a data base 
and to read it when starting a game and retain it on the RAN 102. 

10 

Moreover, it is possible to obtain a flare value Cnn corresponding t a position of the light 
soiu-ce On and intensity Pn by referring to a table for finding the intensity of flares corresponding 
to the intensity of the light source. Although not specifically shovm in the drawing, if the flare 
degree is determined in accordance with the intensity of the light source, the table which retains 

15 the flare value C which conforms only to the intensity of the Ught source may be used. The flare 
value C so obtained can be used in the same manner as the inner product C at and after step 
SI 00, It is also possible to perform the same flare processing. If the flare degree is determined 
by referring to a table, anything (such as morning, evening, rain, fog, or existence of clouds) can 
be included as parameters in addition to the position and intensity of the light source as described 

20 above. The content of the table is not limited to what is shown in Figure 7. 



Instead of the above-described table, fimctions which serve similarly to the able, such as 
Cg(^, P), C=h(^, C=i(P) or C=j(x, y), may be used. 
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An explanation is hereinafter given concerning the case where flares are utilized. A 
position of the virtual sun in a so-called world coordinate system is originally settled. However, 
in order to make it easy to play a race game, it is possible to move the position of the virtual sxm 
as appropriate so that backlight will not be generated. On the contrary, in order to enhance the 
stage effect of a game, it is possible to place the virtual sun where the virtual sun originally does 
not exist and intentionally create a backUght situation, thereby causing flares. 

For example, as shown in Figure 8, it is possible to produce the climax of a game by 
intentionally moving the virtual sun from the regular position of the virtual sun to a position to 
come into view after a goal and by generating flares in pictures after the goal. 

An algorithm of a second special effects picture is hereinafter explained with reference to 
Figures 9 through 14. This algorithm is to express car spinning, tire slips, driving on a bad road, 
etc. more realistically by leaving traces of tires on a road. Moreover, the amount of operations 
for the picture processing is decreased by reducing polygons (or traces of tires) on the screen by 
deleting the traces of tires after a certain amount of time has elapsed. Since the traces of tires 
themselves are not necessary as driving information for a game, the traces are gradually deleted 
from their bottoms in a natxu'al manner so that the amount of information will not become 
excessive. 

Figure 9 is a flowchart which explains an algorithm to display tire traces (or tire marks). 
Figures 10 through 13 explain reading of data, display of the tire marks, etc. Figure 14 shows an 
example where the tire marks are drawn. 
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In this embodiment, for example, five kinds of tire marks concerning which density 
becomes gradually higher, that is, patterns 0 through 4 are used to express the tire traces 
realistically. Each pattern is stored in a data base (ROM). Five storage regions of the RAM or 
registers as shown in Figure 10 are used in order to cause the tire traces to follow the movements 
5 of car tires and to gradually extinguish the traces. 

At first, the main program determines whether or not display conditions of the tire marks 
are satisfied. In other words, a tire mark display routine is executed by determining, for 
example, whether or not tire slips have occurred due to spirming of a car or abrupt pressing on 
10 the accelerator or whether or not a car is running on a bad road by referring to the relevant 
functions or flags which indicate driving conditions. 

Once a tire slip starts, the CPU 101 reads a previous tire position Xn-i fi-om, among five 
RAMs, a top mark RAM at which a top mark flag representing a top position of a tire mark is ^ 
set, and calculates a distance L(=Txn - Xn-i) between the previous tire position and a present tire 
position Txn displayed on the screen, thereby making a new mark length L (SI 32). The position 
Xn-i and the position Txn herein used mean coordinate values in the three-dimensional virtual 
space. The CPU 101 determines whether or not the tire mark length L exceeds a maximum 
length 1 of a basic pattern of the tire mark (SI 34). 

If the tire ark length L does not exceed the maximimi length 1 (S134: No), the CPU 101 
causes the top mark RAM to store the present tire position Txn as an ending position of the tire 
mark (S144). The tire mark length L is stored in the top mark RAM (S146). The CPU 101 
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causes the number of the top mark RAM to be retained as it is without updating the content of 
the flag register for storing the number of the RAM at which the topmark flag should be set 
(S148). 

5 The RAN number is matched with the patterns as shown in Figure 1 3. Data is read from 

the top mark RAM in a cychc manner, thereby drawing the tire mark. In other words, the top 
mark RAM No. 0 is matched with the pattem 4, the top mark RAM No. 1 is matched with the 
pattern 3, tie top mark RAM No.2 is matched with the pattem 2, the top mark RAM No. 3 is 
matched with the pattem 1, and the top mark RAM No. 4 is matched with the pattem 0. As the 

10 pattem changes from pattem 0 to pattem 4, density of the tire mark changes from a light color to 
a dark color. The number of the top mark RAM represents a newest tire trace in terms of time. 

The CPU 101 reads out the darkest pattem (pattem 4) (SI 50). It reads a tire mark 
beginning position Xn-i, a tire mark ending position Txn and a length L from the RAM and 
displays the pattems on the screen (SI 52). It determines whether or not display of all the 

1 5 pattems for the number of RAMs has been completed (S 1 54). 

If the tire mark beginning, ending and length are stored in a plurality of RAMs by the 
preceding tire mark processing (S154:No), the CPU 101 designates that the RAM number be 
checked in a cyclic manner in the downstream order (S156), and reads the tire mark pattems 
which become lighter in color step by step or gradually in the downstream order in accordance 

20 with the RAM number (SI 58). When display of the pattems for the number of RAMS have been 
finished (SI 54: Yes), the CPU 101 once retums to the main program. 
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While the tire mark display conditions are satisfied and until the tire mark length L 
exceeds the maximum tire mark length 1, steps SI 32, 5134, SI 44 through SI 54 are repeated and 
the tire marks are drawn in a manner such that the darkest pattern immediately follows the tire. 

If the mark length L exceeds the maximum mark length 1 (S134: Yes), a mark position 
Pe(=Xn.i + 1) corresponding to the maximum mark length 1 is stored as the mark ending position 
(SI 36). The number of the top mark RAM is increased by one. If the RAM number exceeds a 
maximum value ("4" in this case), the RAM number retums to zero (SI 38). The mark beginning 
position Pe is stored in a new top mark RAM (SI 40). The present tire position Txn and the tire 
mark beginning position Pe are used to find the tire mark length L(=Txn - Pe) by calculation 
(S 142). The present tire position Txn is stored as the mark ending position in the top mark RAM 
(SI 44). The tire mark length L is stored in the top mark RAM (S146). The RAM number to be 
stored in the flag register is set at the number of the top mark RAM updated at SI 38 (SMS). The 
darkest pattern (pattem 4) is read out (SI 50). The tire mark beginning position Pe, ending 
position Txn and length L are read from the RAM and the pattems are displayed on the screen 
(SI 52). It is determined whether or not display of all the pattems for the number of RAMs have 
been finished (SI 54). 

If the tire mark beginning, ending and length are stored in a plurality of RAMS by the 
20 preceding tire mark processing (S154: No), the CPU 101 designates that the RAM number be 
checked in a cyclic manner in the downstream order (5156), and reads the tire mark pattems 
which become lighter in color step by step or gradually in the downstream order in accordance 
with the RAM number (S158). 




The above-described tire mark drawing processing is executed and the tire marks are 
drawn on the screen while the tire mark display conditions are satisfied upon the execution of the 
main program. 

5 An explanation is hereinafter given with reference to Figures 10(a) through 10(e) about 

data retained in RAMO through RAM4 and updating of the retained data in the flag register by 
means of the above-described algorithm. 



Figure 10(a) explains the case where the length L of the tire mark caused by a slip is Al, 

10 that is, less than the mark reference value 1 (SI 34: No). 

It the top mark indicates RAMO, the tire mark beginning position XO and the present 
position Txi are read in at step SI 32 and the length L=All(=Txi - Xo) is calculated. The initial 
tire mark beginning position Xo is the tire position when a slip starts. These values are stored in 
RAMO (SI 44 through SI 46). RAMO is made the number of the top mark RAM to be retained in 

15 the flag register (SI 48). As shown in Figure 13, the number of the top mark RAM corresponds 
to the darkest pattem 4. The beginning, ending and length of the tire mark are read from RAMO 
and the tire mark is drawn according to the pattem 4 (SI 52). In this case, there is one RAM in 
which data are written (SI 54: Yes), this routine is terminated to ref um to the main program. If 
the tire mark display conditions are satisfied, until the mark length L exceeds the maximum 

20 length 1, the above-described processing is repeated and the tire mark of the pattem 4 is 
extended. 
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As shown in Figure 10(b), the present tire position becomes Tx2 and the length L(=Tx2-Xo 
= 1 + Al) exceeds the maximum mark length 1 (S134: Yes). Xi=Xo+l(=Pe) is found and the 
position Xi is stored as the mark ending position in RAMO (SI 36). The top mark RAM is made 
RAMI (SI 38). The present tire position Tx2 and the mark beginning position Xi are used to 
5 calculate the mark length L (=A l=Tx2-Xi) (SI 42). The present tire position Txi is made the 
mark ending position and is stored in RAMI (S144). The mark length L(=A l=TxrXi) is stored 
in RAMI . The number of the top mark RAM to be retained in the flag register and to be read out 
in a cyclic manner is set as RAMI (8148). Data of the pattern 4 is made to correspond to RAMI 
(S150). The dark tire mark of the pattern 4 is drawn according to the data of RAMI (S152). 
10 Moreover, the tire mark of the pattern 3 is drawn according to the data stored in RAMO (S154, 
S156, S158 and S152). Then the CPU retums to the main program. 

As shown in figures 10(c) through 10(e), by repeating the above-described processing in 
the same way, drawing data of the tire mark (the beginning, ending and length of the tire mark) 
are retained in RAMO through RAM4. 

15 

Figure 1 1 shows an example where one round of data preservation onto RAMO through 
RAM4 have been completed. Since there are five RAMs in this embodiment, rewriting is 
conducted in serial order. Figure 1 1(a) shows a situation where one round of rewriting is 
completed and the top position of the tire mark corresponds to RAM2. Figure 1 1(b) shows a 
20 situation where one round of rewriting is completed and the top position is located at RAM3. 
Since the previous data portion of the tire mark which has been rewritten is not displayed, the 
relevant pattern drawn on the screen is extinguished. If the position coordinate Xn is located out 
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of view of the virtual camera, such a position will be regarded as being not subject to the picture 
processing and, therefore, will not be displayed by means of clipping. 

Figure 12(a) explains the case where the data shown in Figure 1 1(a) is drawn as a tire 
5 mark. The pattern 4 is drawn in a pattem length of Al and each of the pattems 3, 2, 1 and 0 is 
drawn in a pattem length of 1 . Drawing density becomes lighter from the pattem 4 to the pattem 
0. Figure 12(b) shows a tire mark drawn by using the data shown in Figure 1 1(b). A drawing 
range of the tire mark has moved from the position Xj through Txg of Figure 12(a) to the position 
X4 through Tx9, following the tire object of a car. The tire mark of the position range X3 through 
10 X4 has been extinguished. This limits the tire trace to a predetermined length and prevents the 
amoimt of operations necessary to display the tire mark from increasing too much. 

According to the algorithm explained with reference to the flowchart of Figure 9, when a 
car stands still, the position information in RAMO through RAM4 is retained and, therefore, the 

1 5 tire mark is being displayed on the screen. On the other hand, when the car is moving, the tire 
mark is drawn, following the tire. This tire mark becomes lighter in color at its bottom. If a 
moving speed of the car is fast, a travel amount L of tires from the position where sampling was 
performed the last time exceeds the maximum mark length 1 in a short period of time. This 
causes the position information in RAMO through RAM4 to shift and the bottom of the tire mark 

20 is quickly extinguished. As a result, the timing to extinguish the drawn tire traces is adjusted in 
accordance with the moving speed of the car. Such a method of drawing pictures makes it 
possible to save memory consimiption, compared to a conventional method of preparing various 
pictures with tire traces drawn in advance (which requires an enormous amoxmt of memory) and 
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of selecting an appropriate picture out of such pictures. A racing car moves at a high speed. In 
such a situation, if it is set to quickly extinguish the tire marks on a course, the number of 
polygons of a game players car and opponent cars within view can be reduced and a bxirden on 
the operational processing for picture drawing can be lessened. If the tire marks continue to be 
5 displayed indefinitely, it will interfere with the game. However, there is no fear of such 
interference regarding the present application because the tire marks are extinguished at an 
appropriate time. 

In the above-described example, a plurality of tire trace pattems (or polygons of traces) 
10 of different density are prepared in advance (Figure 13) and appropriate trace pattems are 

selected to draw the entire traces. However, it is possible to adopt other methods. For example, 
at the step of drawing a tire mark which gradually becomes lighter in color (step SI 58), a trace 
mark of predetermined density may be obtained by performing the processing to make the 
darkest tire trace mark (which is a basic pattern) semitransparent. Specifically speaking, 
15 transparency for the transparency processing at the above-mentioned step is selected fi"om a 
plurality of transparencies which are set by steps according to the number of execution of the 
routine (SI 52 through SI 58). Respective trace marks which have undergone the semitransparent 
processing with different transparencies are combined to form the entire trace. This method 
gives rise to the same results as those in the aforementioned case where a plurality of tire trace 
20 patters of different density are prepared to form the entire trace of density gradually changing 
fi-om the top to the bottom. Furthermore, concerning the trace mark consisting of a plurality of 
polygons, which is displayed according to the routine as shown in Figure 9, the polygons are 
made gradually lighter in color by means of the semitransparent processing and are then 




extinguished in the order first displayed the size of polygons does not change at the step of 
making them lighter), and when the polygons become no longer visible in the end, such polygons 
themselves are removed out of the object of t processing (step S154, Figure 12(b)). 

5 Figure 14 shows an example where a car spins and tire marks (or slip traces) are drawn 

on the screen. A portion of the marks closer to the tires are drawn in dark color and the 
beginning positions of the tire marks are drawn in light color. 

When a tire slip occurs due to, for example, a spin of a car (or object), if tire slip traces 
10 are displayed immediately after the slip, a game player will perceive the realistic expression. 
However, if a certain amoxint of time has passed from the occurrence of the slip, the game 
player's attention to the slip traces will decrease. Accordingly, after the car stops moving and a 
predetermined amoimt of time has elapsed, it may be decided to extinguish the slip traces 
actively. This makes it possible to reduce the nimiber of display polygons (or slip traces) and to 
1 5 lessen the burden on operations of the CPU. 

In the above-described embodiment, an explanation has been give with regard to the tire 
marks. However, this embodiment can be also applied to, for example, ruiming traces of a car 
running on a bad road in a rally, running traces of skis (or track of skis in the snow), traces of jet 
20 skis, or wakes behind a ship. 

An explanation is hereinafter given about a reduction in the amount of operations with a 
video game device. Concerning objects to be projected on a monitor by means of so-called 
three-dimensional graphics, the arithmetic processing is performed such as placement of the 




objects into the three-dimensional virtual space, projection transformation for drawing the 
objects on a plane of projection, modeling transforaiation, and viewing transformation, thereby 
fomiing monitor pictures. Upon perspective transformation, a clipping is performed by fomiing 
a view pyramid and by removing and not displaying the portions outside the display region to be 
5 actually projected on the plane of projection. This clipping contributes to a reduction of the 
amount of operations. 

Another embodiment of this invention performs the clipping even in the display region 
and is intended to further reduce the amount of operations. 

The outline f such an embodiment is explained with reference to Figures 15 through 17. 
Figure 15 shows objects A and B located in the three-dimensional virtual space. Objects A and 
B are respectively composed of a plurality of polygons. As in conventional cases, objects in the 
display regions are read front a data base and are located in the original shape at relevant 
positions. Textures (or patterns) are pasted on the surface of polygons. 

Figure 16 shows an example where object B is placed behind object A when a camera 
position (or visual point) for projection transformation is located at the back off to the left. In 
this case, a portion of object B (the portion which is located behind object A) is invisible from 
20 the camera position. Accordingly, if a data base of the objects is constructed by omitting 

polygons of the invisible portion, the amount of operations for the three-dimensional graphics 
display decreases. 




Figure 17 shows an example where polygons of object B are partly omitted. Even if such 
omission of polygons is conducted, a resultant picture on the plane of projection as seen from the 
camera is the same as that of Figure 16. 

For example, in a car race, cars run on a previously determined course. The course is 
divided into portions in unit length. Concerning scenes which can be seen from the camera for 
each unit, a data base is previously made in the form of, for example, background and a set of 
objects, and data of a relevant scene is read out according to the position of a car and is displayed 
as backgroimd, etc. on the screen. Accordingly, it is possible to provide a data base which 
requires a smaller amomit of operations with a game device by reducing the polygons which 
cannot be actually seen from the camera. 

An explanatilon is hereinafter given with reference to drawings about a method of 
constructing a data base of objects with some polygons which cannot be seen from the camera 
1 5 position within the display region being omitted. 

First, the outline of a picture data processing device for executing an algorithm described 
below is explained by referring to Figure 18. The picture data processing device is composed of 
a computer system, which is divided roughly into: a data processing portion 200; an operational 
20 portion 201 ; a storage portion 202 for retaining data bases such as object tables and polygon 

data; and a CRT display portion 203 for displaying pictures. The data processing portion 200 is 
composed of: an arithmetic processing control portion 21 1 for controlling respective parts in 
accordance with programs retained in a memory 212; a camera position control portion 213 for 
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setting coordinates of a camera (or visual point) position in the three-dimensional virtual space in 
accordance with movements of a car or game programs; an object table deciding portion 214 for 
deciding an object table corresponding to the camera position by referring to the camera position; 
a coordinate transformation matrix generating portion 215 for generating a matrix of coordinate 
5 transformation corresponding to the camera position; a polygon memory control portion 216 for 
designating relevant polygons by referring to the object table; a polygon memory 217 for 
outputting the designated polygon data; a texture memory 218 for retaining textures to be pasted 
on the polygons; a coordinate transformation portion 219 for locating the polygons in the three- 
dimensional virtual space, pasting the textures on the polygons, and performing, for example, 
10 projection transformation by means of the above-mentioned transformation matrix to transform 
the polygons into an image on the two-dimensional screen; a drawing portion 220 for outputting 
a screen picture to a pictlure memory 221; a picture display control circuit 222 for outputting 
picture data retained in the picture memory 221 as picture signals to a CRT display. 

15 Figure 19 is a flowchart which explains an algorithm to construct a data base of objects 

with some polygons which cannot be seen being omitted, by using a conventional object data 
base. 

At first, a data base of three-dimensional graphics is composed by a conventional method 
20 or a data base of three-dimensional graphics which has already been composed is prepared. Data 
of all polygons is loaded from the data base onto a work area of a CPU memory. The polygon 
data includes coordinate data (S202). A number for identification (or polygon ID) is given to 
each polygon. For example, the polygons are numbered in the order of loading (S204). 
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Data of the camera position is loaded onto the work area. The camera position data 
includes coordinates and a facing direction (or vector) of the camera (S206). The number for 
identification (or camera ED) is given to the camera position data. For example, the camera 
position is numbered in the order of loading (S208). 

5 

Subsequently, concerning all the camera positions, a visibility determining processing as 
to whether each polygon can be seen fi-om the camera positions is performed (S210). 

Figure 20 is a flowchart showing an algorithm of the visibility determining processing. 

10 This processing locates all the objects in the three-dimensional virtual space formed in the 

computer system and draws all the polygons. In doing so, it gives a relevant polygon ID nimiber 
to picture elements of each polygon (S252). It performs coordinate transformation, etc. at each 
camera position (or camera ID) and then draws a projected picture as seen fi-om the camera. At 
this time, a method such as the so-called Z buffer method is used to draw, among overlapping 

1 5 polygons in the display regions, the polygons located in fi-ont as visible polygons and not to draw 
the polygons located in the back (S254). It is determined at each camera position according to 
the polygon ID given to the drawn picture element which polygons are to be drawn or not to be 
drawn on the screen (S256). A visible flag table showing which polygons are visible or invisible 
at all the camera positions (or camera ID) is prepared (S258). Then, the processing retums to the 

20 original routine. 

Figure 21 shows an example of the visible flag table. It shows, regarding all polygons at 
all the camera positions (or camera ED), whether or not a relevant polygon can be seen firom a 
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relevant camera position (or camera ID). If it can be seen, a flag "1" is displayed. If it cannot be 
seen, a flag "0" is displayed. 

Subsequently, in order to obtain a data base which represents objects to be drawn at each 
camera position, polygons which have the same or similar patterns of visible flags in the visible 
flag table are made into a group and each group constitutes object data (S212). An identification 
number (or object ID) is given to each object data (S214). 

This procedure is hereinafter explained. Firstly, since a polygon (for example, P0LY4) 
having a flag pattern v^th all "0" cannot be seen on the screen, it is unnecessary to consider it as 
an object to be drawn. Such a polygon is extinguished. Secondly, as shown in Figure 22(a), a 
first polygon POLYO is put in object data OBJO. Thirdly, all polygons with flag patterns which 
coincide with the flag pattern of the polygon POLYO are extracted and added to the object data 
OBJO (Figure 22(b)). The above steps 2 and 3 are repeated regarding the rest of the polygons, 
and polygons having the same flag patterns are gathered and made into groups and the respective 
groups are named object data OBJl, 0BJ2 and so on. 

Next, polygons with similar flag patterns to those of the object data are extracted and 
incorporated into the relevant object data (Figure 22(c)). For example, polygons with flag 
pattems which are different by one bit firom a pattem obtained by a logical sum of flag patterns 
of the respective polygons in the object data are extracted and incorporated into the object data. 
The same procedure is repeated and the polygons are made into groups (or object data) until the 
flag pattems which are different by predetermined bits are checked. 
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Subsequently, a transformation table showing object data which are to be drawn (or can 
be seen) at each camera position is prepared (S216). Figure 23 shows an example of this 
transformation table. Objects to be located at each camera position (or camera ED) in the three- 
dimensional virtual space can be found immediately by referring to this table. 

For example, at camera position 0, object data OB JO, OBJl, 0BJ3 arid so on are located. 
At camera position 1, object data OBJO, 0BJ3 and so on are located. With a game device, the 
camera position is selected in accordance with developments of a game, and relevant object data 
groups are read from the transformation table and polygons composing each object are drawn, 
thereby drawing each scene. 

Moreover, the object data are stored in a data base (S218). The transformation table of 
the objects is stored in a data base (S220). 

It is also possible to execute the above-described algorithm at a high speed by using a 
15 picture processing computer system separate from a video game device and to store, on an 
information storage medium, the resultant data base of object data as game software together 
with programs. 

Figures 24 and 25 show examples of pictures drawn by using object data with polygons 
20 which cannot be seen in the display region being omitted. Figure 24 shows an example of one 
scene at a regular camera position luring a car race with cars running in a game field formed in 
the three-dimensional virtual space. Figure 25 shows the same scene as seen from above. Li the 
region indicated with oblique lines in Figure 25, no polygons are drawn and no picture exists. 
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Accordingly, the amount of operations necessary to, for example, construct the virtual space or 
transform pictures for such a region is reduced. 

Application of clipping to objects existing in view as described above is not limited to 
video games like the above-described embodiments. For example, it can be applied to anything 
which displays the state of the three-dimensional virtual space by transforming it into two- 
dimensional pictures, such as various kinds of simulation for virtual experience. As described 
above, since this invention is capable of expressing flares caused by incident rays from a light 
source, it is possible to enjoy dazzling scenes or dramatically presented scenes. 

Moreover, this invention makes it possible to draw traces of moving objects such as cars 
or skis without comparatively increasing the number of polygons, which is a desirable feature. 

Furthermore, by a picture forming method of this invention, an object data base is formed 
by clipping invisible polygons in the display region. Therefore, it is possible to draw the same 
pictures as those drawn by conventional methods by spending a smaller amount of operations 
than that of the conventional methods. 
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ABSTRACT 

It is an object of the present invention to provide special effects v/hich will make a video 
game more realistic. 



5 When a virtual light source exists in a three-dimensional virtual space, if a light from the 

light source extends toward a camera, a flare is generated on a screen because of incidence of the 
ray of light into a camera lens, thereby forming a dazzling picture in accordance with the state of 
backlight. 



